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Abstract 

This work is concerned with an approach to formu- 
lating the multidisciplinary optimization (MDO) problem 
that reflects an algorithmic perspective on MDO problem 
solution. The algorithmic perspective focuses on formu- 
lating the problem in light of the abilities and inabilities 
of optimization algorithms, so that the resulting nonlin- 
ear programming problem can be solved reliably and effi- 
ciently by conventional optimization techniques. We pro- 
pose a modular approach to formulating MDO problems 
that takes advantage of the problem structure, maximizes 
the autonomy of implementation, and allows for multiple 
easily interchangeable problem statements to be used de- 
pending on the available resources and the characteristics 
of the application problem. 

Key Words: Autonomy, complex system design, dis- 
tributed analysis optimization, multidisciplinary analysis, 
multidisciplinary optimization, nonlinear programming, 
sensitivities, system synthesis 

Introduction 

The underlying theme of this and related papers [1-3] 
is the strong influence of the analytical features of multi- 
disciplinary optimization (MDO) problem formulation on 
the ability of nonlinear programming (NLP) algorithms to 
solve the problem reliably and efficiently. The compan- 
ion paper [3] examines several distributed formulations 
for MDO and concludes that the desirable trait of auton- 
omy for the subsystems that comprise the MDO problem 
may come at a price: In some of the approaches consid- 
ered, the system-level constraints introduced to relax the 
interdisciplinary coupling and enable disciplinary auton- 
omy can cause analytical and computational difficulties 
for optimization algorithms. 

The premise of the present paper is that algorith- 
mic considerations should enter strongly into decisions 
about problem formulation. We focus both on the MDO 


problem structure — in particular, the underlying multi- 
disciplinary analysis — and the need to solve the prob- 
lem reliably and efficiently. We propose a modular ap- 
proach to MDO problem formulation that reflects both 
concerns. We examine several MDO problem formula- 
tions and show how the formulations are related to one 
another. We call the approach modular because, given 
the appropriate disciplinary sensitivity information, it is 
straightforward to pass from one formulation to another 
in the context of optimization. Similar techniques were 
used in [4] to derive the flexible algorithms for different 
classes of formulations in the framework of reduced basis 
algorithms. 

The conclusion (and contribution) of this paper may 
be summarized as follows: an appropriate implementa- 
tion of the disciplinary information allows one to com- 
bine the disciplinary “pieces” into several MDO problem 
formulations and solution algorithms with minimal extra 
effort. The re-use of information is facilitated by the struc- 
ture of the problem due to disciplinary analyses and inter- 
disciplinary coupling. That is, the disciplinary analyses 
can be viewed as nonlinear equality constraints. Using 
this fact, function and derivative information, if imple- 
mented appropriately, can be easily re-used in the context 
of reduced-basis optimization algorithms. Moreover, the 
function and derivative information required for optimiza- 
tion is similar for all derivative-based algorithms. We ar- 
gue that the structure is not only a convenient device, but 
should be exploited in order to formulate and solve the op- 
timization problem efficiently in the framework of robust 
nonlinear programming algorithms. 

Multidisciplinary analysis 

For clarity, we present our discussion of formulations 
for a two-discipline MDO problem. Discipline 1 and Dis- 
cipline 2 may represent, for instance, the aeroelastic in- 
teraction between aerodynamics and structural response 
for a wing in steady-state flow. In this section, we briefly 
present the multidisciplinary analysis and the motivation 
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for the present work. 

We assume that each constituent subsystem of the 
two-discipline model problem is based on a disciplinary 
analysis. Each discipline takes as its input a set of disci- 
plinary design variables l iy a set of shared or system-level 
design variables s, and some parameters. The variables l\ 
and I 2 are local to Disciplines 1 and 2, respectively. Let 
the vector a t - represent the totality of outputs from a given 
discipline, including all data passed to the other discipline 
as parameters and quantities passed to design constraints 
and objectives, if any. In the context of MDO, the parame- 
ters fed into Discipline i are derived from the analysis out- 
puts a ; , j 7^ of the other discipline, and are not directly 
manipulated by the designer in Discipline i. We denote 
the totality of design variables by x, i.e., x — (s, / 1 , /2). 

The coupled multidisciplinary analysis system (MDA) 
reflects the physical requirement that a solution simulta- 
neously satisfy the two disciplinary analyses. The input 
parameters to each discipline are required to correspond to 
some (or all) of the outputs aj from the other disciplinary 
analysis. We write the multidisciplinary analysis as a si- 
multaneous system of equations. Given a? = (s,l i,/ 2 ), 
we have a block system 

ct[ — v4i(s,/ 1 ,a 2 ) ( 1 ) 

ci 2 — A 2 (5 , 12 j fli ) • ( 2 ) 

In the context of MDO, the blocks of the system repre- 
sent the disciplinary analyses together with the necessary 
interdisciplinary couplings. 

Solving the first equation results in the analysis out- 
puts a 1 of Discipline 1, and solving the second equation 
produces the analysis outputs a 2 of Discipline 2. The out- 
puts are also known as disciplinary responses. The MDA 
implicitly defines and a 2 as functions of (sj\ ,/ 2 ): 

= a 1 («s, /1 , / 2 ), a 2 = a 2 (s, h 1 ^2)- 

In analysis mode or at each iteration of a conventional 
optimization procedure, the design variable vector x is 
passed to the MDA system. The system is then solved 
for the state vector a — (ai , a 2 ). The solution is accom- 
plished via an iterative procedure such as Gauss-Seidel or 
an inexact Newton method. 

The implementation of MDA, arguably, takes most of 
the integration effort in solving MDO problems. It may 
require a degree of assembly of the MDA and extensive 
interaction among disciplinary experts. For instance, for 
design one needs to develop a sensitivity capability that 
involves the MDA. Because MDA is not usually con- 
verged to a high degree of accuracy, the computation of 
finite-difference derivatives that involve MDA is difficult. 
In addition, from the nonlinear programming perspective, 
far from solutions, it is preferable not to follow the com- 
plicated and expensive constraint manifold defined by so- 
lutions of (1 )— (2). Instead, the fastest (Newton-based) 


optimization algorithms rely on the so-called infeasible 
principle that calls for attaining feasibility with respect to 
all constraints only at solutions. For these reasons, dis- 
pensing with MDA is one of the main motivations of dis- 
tributed optimization approaches [5]. 

However, completely avoiding MDA may be prema- 
ture. First, solving the coupled equations ( 1 )— (2) leads 
to designs in which the coupled disciplines give a physi- 
cally consistent (and thus meaningful) result. Therefore, 
the MDA is generally performed at least to obtain a base- 
line design. Second, when optimization algorithms are 
applied to formulations that decompose the MDA, the in- 
termediate iterates or designs will not necessarily satisfy 
the MDA (l)-(2) until a solution is reached. Thus, if an 
optimization process has to be stopped due to exhausted 
resources, the final design may not be physically realiz- 
able. And, finally, if the bandwidth of coupling among 
the disciplines is great, decomposing MDA may not be 
a viable option, due to the need for introducing a large 
number of auxiliary variables that assist in decoupling the 
MDA. 

The approach proposed here attempts to reconcile the 
apparent contradiction between the need to establish the 
autonomy of integration — the ability to implement the 
requisite computational modules independently along the 
disciplinary lines — and the current need to keep MDA and 
MDA-based optimization methods in the arsenal of MDO. 
This is accomplished by considering the modularity (i.e., 
re-usability) of disciplinary information in the context of 
MDO formulations and optimization algorithms. 

In summary, we do not reject the MDA and MDA- 
based optimization problem formulations. Instead, we 
propose a computational “recipe” for implementing MDO 
problems in a way that facilitates experimentation with 
MDO problem formulations. 

Formulations of a two-discipline model problem 

This section describes several optimization problem 
formulations, with a focus on rigorous notation and the 
relationship among the described formulations. Having 
stated the formulations in detail, we later examine them to 
see how we can re-use the disciplinary function and sen- 
sitivity information in one formulation in the implemen- 
tation of other formulations. Obviously, the perspective 
advocated in this work is not limited to the formulations 
under discussion. 

Fully integrated optimization formulation 

The conventional approach to MDO problem formu- 
lation is to impose an optimizer over the MDA. Given the 
need to satisfy the MDA at a solution, this formulation is, 
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arguably, natural. We call it the fully integrated optimiza- 
tion (FIO) formulation and use it to represent the original 
problem, i.e., the problem one ideally wishes to solve. Its 
mathematical statement is 

min fpio{x) = f(x,a\{x), a 2 {x)) 

X 

s.t. g 0 {s,l l ,a l (x),a 2 (x)) > 0 
gi{s,h,ai(x)) > 0 
g2(s,h,a 2 (x)) > o, 

where, given x , we solve the multidisciplinary analysis 
system (l)-(2) for the disciplinary analysis outputs ai(x) 
and a. 2 (x). The function / represents the system-level ob- 
jective. 

The FIO formulation is also known as Multidisci- 
plinary Feasible [6] in the nonlinear programming com- 
munity and sometimes as “All-in-One” in the engineering 
community. The first term refers to maintaining feasibility 
with respect to the multidisciplinary analysis, but is some- 
what misleading because it also appears to imply feasibil- 
ity with respect to disciplinary constraints. The second 
term resembles the term “All-at-Once” which sometimes 
refers to a method at the opposite end of the formulation 
spectrum (see the next subsection). The term “FIO” is 
proposed to avoid these ambiguities in the naming con- 
vention. 

The fully integrated formulation reflects a variable re- 
duction technique. At each iteration of an optimization 
procedure applied to (3), the design variable vector x is 
passed to the MDA system. Solving the system for the 
state vector a reduces the dimension of the optimization 
problem (3) by making it a problem in x only; a — a(x) 
is a dependent variable. 

The drawback of this formulation is the need to solve 
the MDA at each iteration. The drawback is also its ben- 
efit, in that all optimization iterates are feasible with re- 
spect to the MDA, even far from solution. Thus, even if 
optimization cannot continue to a solution, the intermedi- 
ate designs will be physically realizable. Another benefit 
of (3) is that is has the smallest possible number of opti- 
mization variables. 

SAND formulation 


A formulation class at the opposite end of the spec- 
trum views the full MDA purely as equality constraints: 


convention we adopt. It has also been called the All-at- 
Once approach (e.g., [6]). 

SAND is motivated by the nonlinear programming ex- 
perience which suggests that allowing optimization algo- 
rithms the freedom not to follow the MDA constraint man- 
ifold (i.e., not performing MDA) far from solutions facil- 
itates finding solutions at a lower expense. Optimality is 
attained together with feasibility only at solutions. 


Distributed analysis optimization 

The class of distributed analysis optimization (DAO) 
formulations relies on the introduction of auxiliary vari- 
ables and consistency constraints that decouple the MDA, 
thus imparting some degree of autonomy to the disci- 
plinary computations. 

We first rewrite the MDA (l)-(2) as the equivalent 
system 


a i *— — 0 

a 2 — ^2( s ) hr *i) — 0 

h - «i = 0 

t 2 — fl'2 — 0. 


(5) 

( 6 ) 


The auxiliary variables 1 1 and i 2 stand in for the disci- 
plinary responses a\ and a 2 , respectively. They serve to 
decouple the MDA equations (l)-(2). 

We can now re-write the fully integrated formulation 
(3) as an equivalent formulation 

min fDAo(s,t u t 2 ) = f(sJiJi) 

* J 2 J 1 2 

s. t. go(s,ti,t 2 ) > 0 

gi{sj u ti) > 0 (7) 

g2(s,h,t2)>0 

t\ — ai(s, l \ , £ 2 ) 

*2 = <* 2 ( 5 , hJi), 


where, given (s, h , , ^ 2 )* disciplinary responses 

ai(s, ^ 1 , * 2 ) and a9(s, h.U) are found by solving the dis- 
ciplinary analysis equations 

a\ — A\(sJ 1,(2) = 0 
«2 - Ao{s J2J1) = 0 . 


min fsAND(x>a i,a 2 ) = f(x,a u a 2 ) 

x , a 1 , a 2 

s.t. at — A\ (s, 1 1 , a 2 ) = 0 
a 2 — A 2 (s, / 2 , fli ) = 0 

go(s, a 2 ) > 0 
gi( s , h ? a i) > 0 
g 2 {$, h 1 ^2) > 0 . 

In structural optimization, this approach is known as Si- 
multaneous Analysis and Design (SAD or SAND) [7], a 


Equations (5) and (6) are examples of interdisciplinary 
consistency constraints. The degrees of freedom intro- 
duced by expanding the set of optimization variables to 
include , t 2 are removed by the consistency constraints. 

The DAO approach introduces a degree of disci- 
plinary autonomy but respects the requirements of con- 
ventional nonlinear programming analysis and algorithms 
and avoids the analytical difficulties of the bilevel ap- 
proaches discussed shortly. 
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Other members of the DAO class appeared earlier 
in [4,6,8] under the names of “in-between” or “indi- 
vidual discipline feasible” (IDF) approaches. The latter 
name is unfortunate since it suggests that the formulation 
maintains designs that satisfy the disciplinary design con- 
straints, whereas it really refers to the fact that the anal- 
ysis outputs are consistent with (“feasible with respect 
to”) the disciplinary analyses, though not the multidisci- 
plinary analysis. To avoid this confusion, we use the term 
DAO to refer to a general class of methods that includes 
the IDF approach from [4,6,8]. In this formulation, we 
treat the implicit interdisciplinary consistency constraints 
in the multidisciplinary analysis as explicit equality con- 
straints in the optimization problem. 

In the DAO approach, further closure with respect to 
disciplinary design constraints or system level constraints 
is determined by the kind of optimization algorithm used. 
Ideally, one would be able to start with design variables 
(5, l] , l 2 ) for which the disciplinary design constraints de- 
fined by the gi are satisfied. One could then apply an op- 
timization algorithm that maintained feasibility with re- 
spect to these constraints so that all subsequent designs 
obtained in the course of the optimization satisfied the 
disciplinary design constraints, thereby accomplishing the 
same end that other problem formulations (e.g., Collabo- 
rative Optimization) achieve through the definition of its 
disciplinary optimization problems. 

On the other hand, it might be difficult to find initial 
design variables (s,l 1 J 2 ) for which the disciplinary de- 
sign constraints are satisfied. To address this difficulty, 
we can expand the space of variables as follows: 

min fDAo(s,tuh) 

S ,<7 | j {7 2 ,1 1 ,t 2 

S. t. 5fo(<To, 1 1 , 1 2 ) > 0 

9\{<T lJuti) > 0 
<72(02^2* *2) > 0 
t\ — , /j , * 2 ) (8) 

1 2 — a 2 (<T2,h,ti) 

(T 0 - S 
<J\ — s 
a 2 = s. 

This relaxes the requirement that the disciplinary design 
constraints be satisfied with the system-level values of 5. 
In particular, we now have the flexibility to select the ini- 
tial <Ji in a way that the disciplinary design constraints 
are satisfied, exactly as in Collaborative Optimization. 
One can then apply an optimization algorithm that en- 
forces feasibility with respect to the disciplinary design 
constraints. 

It is straightforward to verify that DAO is equivalent 
to the original FIO. This makes DAO easy to analyze; for 
instance, if standard constraint qualifications are satisfied 
by the original problem, then they also hold for the DAO 


formulation. The convergence properties of optimization 
algorithms applied to DAO are those of the algorithms ap- 
plied to conventional FIO. Given a good solver for equal- 
ity constrained optimization problems, the method is ex- 
pected to be efficient. We note that nonlinear equality con- 
straints are usually considered undesirable in engineer- 
ing optimization, possibly due to the preference for fea- 
sible iteration methods in engineering optimization soft- 
ware (e.g., [?]). However, most state-of-the-art methods 
in nonlinear programming do not maintain feasibility with 
respect to nonlinear equality constraints at every iteration. 
Instead, feasibility is attained only at solutions. Thus, a 
good equality constrained solver can generally handle ad- 
ditional nonlinear equality constraints with relative ease. 

Collaborative Optimization 

Collaborative Optimization (CO) [9-20] is a bilevel 
approach with a system-level problem of the following 
form: 

min fisJiJo) 

^9) 

s. t. C(s,t u t 2 ) = Q. 

There are A r interdisciplinary consistency constraints 
C = c,v} which we describe presently. 

The system-level problem controls the system-level de- 
sign variables s and interdisciplinary coupling variables 
which serve as system-level target values for the 
disciplinary inputs and outputs a\ and a 2 . 

To reformulate (3) along the lines of CO, we intro- 
duce new disciplinary design variables < 11,02 that relax 
the coupling between the subsystems through the shared 
system design variables s. The variables cr t serve as local 
copies (at the level of the disciplinary subproblems) of the 
shared variables s. 

The system-level problem issues design targets 
(s, t \ , < 2 ) to the constituent disciplines. In the lower-level 
problems, the disciplines design to match these targets, 
as follows. In Discipline 1, we are given (s, £ 1 ,^ 2 ) and 
compute ai(s,ti,t 2 ) and /1 ( 5 , < 1 ,^ 2 ) as solutions of the 
following minimization problem in (crj , ) : 

min ± [|| (t \ s || 2 + || ai{(Ti,l u t 2 ) - <1 || 2 1 

(7i,0 L J 

s. t. gi(^iJuai((TiJut 2 )) > 0, 

(10) 

where a\ is computed in this disciplinary optimization 
problem via the disciplinary analysis 

o\ = Ai(<xi,li, t 2 ). 

Overbars (e.g., & 1 J 1 ) indicate optimal solutions of sub- 
system problems as a function of system-level variables. 
In the disciplinary subproblem ( 1 0), the system-level vari- 
ables (s,i 1 J 2 ) serve either as parameters or targets that 
we seek to match. An analogous problem for Discipline 2 
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defines solutions cro(s, < 1 ,^ 2 ) and / 2 (s\ t[ } to) of the prob- Optimization by Linear Decomposition 
lem ~ ' 


min 

o 2 ,h 

S. t. 


<7 2 — S || + || do 2, ^2 , G ) — 1 2 

92(<^2 J2^ ^2(0-2 J2 Ji)) > 0 . 


Again, a 2 is computed via the disciplinary analysis 


(ID 


a 2 = /1 2 (<t 2 , / 2 , ^ 1 ) . 

Reformulating the FIO formulation along the lines of 
CO also requires the introduction of the third set of 
system-level constraints and a “Discipline 0” subproblem 
that represents the system-level design constraint. Op- 
timization of “Discipline 0“ treats the system-level de- 
sign constraints to obtain <xo(Mi,0), Ci(Mi,0)< and 

C2 ( ^ , £i, 0 ): 

min | [|| <t 0 - s || 2 + || <1 - t\ || 2 + || C2 - h || 2 ] 
S. t. .^(o-O.CliCs) > 0 ' 

( 12 ) 

Disciplinary minimization subproblcms of the form 

(10) -( 12) distinguish CO. The subproblems can be solved 
autonomously. By solving the subproblems, we eliminate 
the disciplinary design variables U from the system-level 
problem, and decouple the calculation of the disciplinary 
analysis outputs a*. Information from the solutions of 
the disciplinary problems (10)-(1 1) is used to define the 
system-level consistency constraints c*. 

We discuss the version of CO in which the consis- 
tency condition is to drive to zero the value of the tar- 
get mismatch objective in subproblems (10)-(I 1). At the 
system-level, the interdisciplinary consistency constraints 
are simply the optimal values of the objectives in (10)- 

(11) . That is, the consistency constraints C — (ci,c 2 ) are 
defined as 


C 0 (S,<! 


[ll tl 

.<2)-s|| 2 


+ 

|| <i(Mi, 

h)-h | 



+ 

|| C2(Ml, 

to) — to | 


(13) 


■‘Hi 

II MMi 

,< 2 ) -s || 2 + 


II 



-<l,<2),<l) ~ti || 2 ] 

(14) 

C2(Ml 

><2) = 5 

II 

, < 2 ) — s ||" + 


II' 

MM 5 , t\ 

l , t2),h(s, 

. tl, < 2 ), < 2 ) ~ <2 ||"1 

(15) 


Optimization by Linear Decomposition (OLD) [21- 
24], maintains interdisciplinary consistency at the system 
level while seeking to minimize the violation of the disci- 
plinary design constraints at the subsystem level. 

In the lower-level problems, the disciplines use their 
local design degrees of freedom to minimize the violation 
of the disciplinary design constraints, subject to matching 
the target value for the disciplinary output that is fed into 
that discipline. In Discipline I, we are given (s, / and 
compute / x (s, t\ , to) as a solution of the following mini- 
mization problem in l \ : 


min c x (s, l\ ,t\ , f 2 ) 

1 1 

s. t. t\ — a x (s, l \ , / 2 ) i 


(16) 


The analysis output a x is computed in this disciplinary 
optimization problem via the disciplinary analysis 


Cl 1 — A i ( S , / 1 , 1 2 ) . 


In the disciplinary subproblem ( 1 6), the system-level vari- 
ables (s,t . ! , t 2 ) serve as parameters in the disciplinary op- 
timization problem. 

The disciplinary objective c x is any function with the 
following property: 


For any (s,t 1} to), we have 

ciisJututo) < o 


if and only if g { (s, /j t cii(s, / x , * 2 )) > 0 for 
all /i satisfying ai(s,/i,/ 2 ) — t x = 0. 


There is an analogous problem for Discipline 2. Given 
(Mi, * 2 ), we compute l 2 (s, t \ , t 2 ) as a solution of the fol- 
lowing minimization problem in / 2 : 


min c 2 (M 2 ,*M 2) 
h 

S. t. to — a 2 (&2 , ^2 , L ) * 


(17) 


Again, a 2 is computed via the disciplinary analysis 


cio — A 2 (s,/ 2 ,G)' 


We call this version C0 2 , where the subscript “2“ refers 
to the fact that the C( are sums of squares. 

Simple examples of optimization problems formu- 
lated as Collaboration Optimization can be found in [ 1 ]. 


The subproblems ( 1 6)— ( 1 7) can be solved au- 
tonomously. As in CO, we eliminate the disciplinary de- 
sign variables /* from the system-level problem via the 
solution of the disciplinary subproblems. 
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The optimal value of the objective in the disciplinary All the approaches we discuss here can be viewed 
problems (16)-( 17) defines the system-level consistency from the perspective of eliminating various subsets of 
constraints c, . The resulting system-level problem is variables from the SAND formulation. For instance, if we 


min f(s,ai{s,l l (s,t u t 2 ),h),a 2 (s,h(sJi,t 2 ),ti)) 

S 1 ,t2 

s. t. MMi,MMi(MM2), MM2(MM2),M) 

c\ (s> (^, t \ , to ) , ^ 1 , to) £ 0 

C2(M2(Ml,<2Ml,*2) < 0. 

(18) 

One choice of discrepancy function is 

MMMM 2 ) = y^(min(0,MMi»MMM2)))) 2 

09) 

M s > / 2 , < 1 , L>) = ^(min(0, gi(s , / 2 , a 2 ( 6 ’> M))) 2 . 

( 20 ) 

This objective is smooth (C 1 ). Also note that a > 0, so 
the system-level constraint c, < 0 is tacitly an equality 
constraint c, — 0. 

OLD has been proposed in connection with an algo- 
rithm for its solution (e.g., [?,23]). The algorithm at- 
tempts to avoid the expense of performing subsystem op- 
timization problems every time a constraint or a constraint 
derivative is required for the solution of the system-level 
optimization problem. Instead, [?, 23] propose an ap- 
proach that could be viewed as analogous to sequential 
quadratic or linear programming (SQP or SLP, respec- 
tively). In this approach, the system-level problem is 
solved with linearized constraints; i.e., for each design cy- 
cle, the constraint value and constraint derivative are held 
constant. The distinction from SQP or SLP is that the 
objective is used instead of its quadratic or linear model. 
This algorithm will be subject to the analytical features of 
OLD as would be all algorithms that rely on linearlization 
of the constraints, such SLP or SQP. 

Relationship among the formulation s 

Approaches to MDO problems are generally based 
on techniques for eliminating variables from the original 
problem. The variables are eliminated by enforcing vari- 
ous subsets of the constraints in different ways. In [25], 
we say that an MDO formulation is closed with respect to 
a given set of constraints if the formulation — rather than 
an optimization algorithm for its solution — assumes that 
these constraints are satisfied at every iteration of the opti- 
mization. If the formulation does not necessarily assume 
that a set of constraints is satisfied, we say that that for- 
mulation is open with respect to the set of constraints. 

For instance, consider conventional optimization ap- 
plied to the FIO formulation. We perform a multidisci- 
plinary analysis at each step. This corresponds to main- 
taining closure of all the disciplinary analysis constraints 
in (3). 


begin with a SAND formulation but require that our de- 
signs satisfy the equality constraints representing the mul- 
tidisciplinary analysis. Begin with the following SAND 
formulation, 

min /(s,/i, * 2 ) 

s Ji J 2 J 1 ,*2 

s. t. gi(s,h,ti) > 0 

9 'i (s, lo 1 f 2) ^ 0 

/!=«! (21) 

1 2 — Cl n 

a i = A \ (MM 2 ) 

ci 2 = A 2 (5, lo , £ 1 ) . 

If we require that at every iteration a\ and a 2 satisfy the 
last two equality constraints, 

ai — Ax (s, /1 , to) = 0 

a 2 _ A 2 (s , / 2 t t 1 ) = 0, 

the we obtain the DAO formulation (7). In this reduction 
we are using these equality constraints to eliminate the 
analysis outputs ai, a 2 as independent variables from the 
optimization problem. 

If, in addition, we eliminate M £ 2 as independent vari- 
ables from (21) by always requiring that 

t\ — MM M 2 ) 

to — a 2 ( s , M £ t ) , 

then we obtain the fully integrated approach (3), since we 
are requiring our designs to satisfy the multidisciplinary 
analysis consistency equations ( 1 )— (2). 

OLD can be viewed as taking the further step of elim- 
inating the disciplinary design variables / 1 , / 2 as indepen- 
dent variables from the optimization problem, in addition 
to eliminating £1 , to. This elimination is accomplished via 
the subsystem problems (16)— (17). Thus, in OLD, multi- 
disciplinary analysis is performed at each iteration. 

CO, on the other hand, eliminates the disciplinary de- 
sign variables l u l 2 in DAO via (10)-(11), but does not 
eliminate the coupling variables t\,to. Like DAO, the 
multidisciplinary analysis is enforced via the system-level 
constraints. 

Modularity in implementation 

In this section we illustrate how the computational 
modules needed for optimization algorithms, particularly 
the elements needed for sensitivity calculations, can be 
implemented autonomously by discipline. Moreover, one 
can reconfigure the same set of computational elements to 
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implement one or other of the formulations discussed pre- 
viously, This suggests that, if properly implemented, all 
of the formulations we have discussed require roughly the 
same amount of work to implement, and much of the im- 
plementation can be done autonomously in the individual 
disciplines. 

For instance, consider the sensitivity information re- 
quired to apply an optimization algorithm to DAO. We 
will show that the same pieces are needed to implement 
optimization for the fully integrated approach. Optimiza- 
tion of DAO requires the following sensitivities. For the 
objective / dao(s , t i,tn), we need 


5/5/5/ 

ds 1 5 /j ’ 5 *i 


(22) 


For the design constraints ($, h , t x ) and g 2 (s, Inf 2) we 
need 


dg 1 dgi dg\ 
ds ’ dh ’ dt \ 


and 


5 ffo dg 2 dg 2 
ds ’ 5/2 ’ dt 2 * 


(24) 


Finally, for the consistency constraints h - 
and O — /l 2 (s, ln } ti ) we need 


dA , 

dA x 

5/1 1 


ds 

’ dl x ' 

dtn 

(25) 

5/1 2 

oa 2 

dA 2 


ds 

din 

dt\ 

(26) 


In FIO approach, we need to compute the sensitivities 
of the objective 


If 10 (5, /1 , In) = f{s , a\ (s, /1 , / 2 ), a 2 (s, / 1 , / 2 ) ) ■ 


/ , 

dA i \ 


da j 

\ 

1 0 

da 2 | 


dh 


1 — 2 

' i 


da 2 


\ < 9 aj 


dh 

) 


and 


dAi \ 

*:)■ 

(31) 


/ 

dAn 

V 5ai 


dAi 

dan 

I 


( 

din 

dan 

\ dh 


0 


dAn 

~dh 


(32) 

which must be solved for the sensitivities of a,y and an 
with respect to the design variables (s,/i,/ 2 ). (These 
are discussed as the “generalized sensitivity equations” in 


[26]). 


Now compare the quantities required for the FIO sen- 
sitivity calculations (27)— (32) with those listed in (22)- 
(26) as required for the DAO sensitivity calculations. We 
sec that these are the same. Moreover, these constituent 
pieces can be implemented for both approaches in a man- 
ner that respects disciplinary autonomy, if one starts with 
the non- integrated pieces of the multidisciplinary analysis 
as in the DAO formulation. These pieces are then inte- 
grated differently in DAO and FIO; however, the disci- 
plinary building blocks are the same. 

A similar examination of the sensitivities of the de- 
sign constraints g x and g 2 in the FIO approach leads to 
the same conclusion. The computational pieces needed 
to implement optimization for the FIO can be assembled 
from those needed to implement optimization for the DAO 
formulation. 


By the chain rule, 


dfno 

Of 

i df , 

da i df 

dan 

(27) 

ds 

ds 

+ ^r 

~d7 + d^ 

ds 

df FIO 

dj_ 

da i 

df dan 


(28) 

dh 

da i 

dh + 

dan dl\ 


dfFlO 

5/ 

da x 

df dan 


(29) 

dl 2 

da \ 

dl 2 + 

dan din 



We compute the derivatives of a 1 and an by implicit dif- 
ferentiation of the multidisciplinary analysis equations 


Likewise, if one examines the sensitivities that must 
be computed for the disciplinary subproblems in either 
CO or OLD, one finds that they involve the pieces in (22)- 
(26). The sensitivities of the system-level constraints are 
then computed via post-optimality sensitivity analysis of 
solutions of the disciplinary subproblems. This requires 
only computational components that are present in the 
DAO formulation, as well. 

Algorithmic interactions 


a\ — A\ (sj 1 , an) = 0 

an — An(s, In, a\) = 0 . 

This yields 


j dAi \ 

( ) 


0Ai_ \ 

dan 1 

1 ds 


ds 


\ da 2 


5/1 2 

V 5 ai / 

\ ds / 


\ ds J 


(30) 


In the previous section we saw how one could, in prin- 
ciple, rearrange the computational components associated 
with the optimization of one formulation to obtain the 
pieces need to implement another. Of course, this may 
require significant effort to do. In this section we discuss 
how for some of the formulations, minor changes in an op- 
timization algorithm designed for its solution may yield 
an optimization algorithm for the solution of an alterna- 
tive formulation. This can make it straightforward to pass 
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between formulations and facilitates the use of hybrid ap- 
proaches, e.g., approaches that may use one formulation 
far from solutions and another close to solutions. 

As an example, we examine the DAO, FIO, and 
SAND formulations, and for simplicity, consider only the 
constraints formed by the disciplinary analyses and inter- 
disciplinary couplings. Thus, the simplified FIO formula- 
tion is 

min / fto ( x ) = f(x, cii(x),a 2 (x)), (33) 

where, given x, we solve the multidisciplinary analysis 
system 

( ^l( x> ) A _ f Gl — Ai (x*, f/i (#), «2 (^*) ) \ _ n 

\ A%(x) ) \ fl2 — An(x t ai(2 i ), rto(^)) / 

(34) 

The simplified SAND formulation is 

min fsAND(x,ax } a 2 )=: f(x,ai,(i'>) 

x ,a i ~ 

s. t. A\ (x, a\, a 2 ) = 0 (35) 

A 2 {x, ai, a 2 ) = 0. 

Finally, the simplified DAO formulation is 

min fDAoix, a \ , a 2 ) 

^» a l.«2ifl»*2 

s. t. t x ~ ai(xj u t 2 ) = 0 (36) 

h — <*2{x,tut 2 ) ~ 0. 

Let Wi be the matrix representing the basis of the null- 
space associated with the derivative of the block A* . Then, 
relying on implicit differentiation and the derivations in 
[4], we note the following relationship among the sensi- 
tivities required for the three methods: 

• Suppose, (or, a) is feasible with respect to (34). 
Then the (projected) gradients at (x, a) of the FIO 
and SAND formulations are related by 

^ IfIo(x) — \\ 54 AT D ( x i a ) ,af. S’ A N D ( X , (t ) , 

where Vs sand denotes a particular basis for the 
null-space of VA T in the SAND approach. 

• Suppose that ( x,a ) is feasible with respect to (36). 
Then 

D AO^ x D AC){x , Cl) — 

WsAND ( x > a Wx,af.$AND(x } a). 

One can then use these relationships to implement a 
reduced-basis optimization algorithm for the three formu- 
lations with minimal modifications. Here we only sketch 
the conceptual algorithm. 

Consider one step of a reduced-basis algorithm for the 
SAND formulation: 


1 . Construct a local model of the Lagrangian about the 
current design. 

2. Take a substep to improve feasibility. 

3. Subject to improved feasibility, take a substep to 
improve optimality. 

4. Set the total step to the sum of the substeps, evalu- 
ate and update. 

Performing the multidisciplinary analysis (34) after 
step 4 yields a corresponding algorithm for FIO. Solv- 
ing the disciplinary equations as in DAO, we obtain an 
algorithm for DAO. Thus, passing between algorithms for 
distinct formulations is a straightforward step. 

Incorporating the inequality constraints into this pro- 
cedure is more involved and will be considered elsewhere. 
Here we wish to emphasize the general principle: by judi- 
cious implementation of the disciplinary sensitivity com- 
ponents, one can impart a large degree of flexibility to 
portions of computation. 

Concluding remarks 

In this paper, we discussed the requisite computational 
components (the function and derivative information) for 
the implementation of optimization for several MDO for- 
mulations. The amount of direct and auxiliary informa- 
tion that has to be implemented differs from one formu- 
lation to another. For instance, distributed optimization 
approaches optimize with respect to local variables at the 
subproblem level and with respect to the global variables 
and interdisciplinary couplings at the system level, while 
distributed analysis approaches optimize with respect to 
the complete set of variables at the system level. How- 
ever, the problem structure of MDO ensures that simi- 
lar sensitivity information — and hence the implementa- 
tion effort — will be required for ail formulations. 

Moreover, if the disciplinary sensitivity information is 
implemented appropriately, one can transfer sensitivity in- 
formation among several of the formulations in a straight- 
forward manner and with minimal expense, thus enabling 
experimentation with a variety of problem formations. We 
gave an example of such re-use of information with min- 
imal expense for the DAO and FIO formulations. While 
DAO formulation does not exhibit the same degree of ex- 
ecution autonomy as do the bilevel optimization methods 
we discussed (CO and OLD), it does exhibit an auton- 
omy of problem integration or implementation and can be 
solved by conventional optimization algorithms robustly 
and efficiently. 

As a matter of methodology, we caution against imple- 
menting the multidisciplinary analysis in an obvious man- 
ner (i.e., simply via a fixed-point iteration), without con- 
sideration of later integration into an optimization prob- 
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lem. The multidisciplinary analysis, if implemented in a 
modular fashion, can be an end in itself, but can also be 
used in a variety of optimization problem formulations. 

In summary, when examining candidate problem for- 
mulations and optimization algorithms, re-use of disci- 
plinary information and the flexibility in formulation and 
solution should be considered. 
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